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ABSTRACT 

The concepts of dynamic programming and 
pattern matching are used in a postprocessing 
technique for voice pitch tracking. The dynamic 
programing is used to achieve a smooth pitch 
contour based on information in the current and 
previous frames. A voicing decision is made based 
on matching the smooth contour from the dynamic 
programming with a set of reference templates 
which are representative of voiced and unvoiced 
speech. Three postprocessing techniques; the 
dynamic programming technique, nonlinear anoothing 
and median smoothing are appended to three 
standard pitch tracking algorithms. A comparative 
evaluation of these postprocessing techniques is 
performed over a data base of 58 male and female 
speakers ranging frcm 6 to 87 years of age. It is 
shewn that significant improvement in the 
performance of the pitch tracking algorithms can 
be obtained with the dynamic . programming 
postprocess ing . 

INTRODUCTION 

Most pitch tracking algorithms fail because 
of anamalous (aperiodic) behavior of the vocal cord 
vibrations of the speaker. This behavior is 
attributed to such things as start-up problems at 
the beginning of voiced segments or by low speech 
effort at the end of a phrase. The anomalies can 
manifest themselves as irregular pitch periods or 
as regions where every other pitch pulse varies 
widely in amplitude. If a person is visually 
extracting a pitch contour, he will look to nearby 
areas of relatively periodic speech to extend the 
pitch into the region of difficulty. This same 
type of approach can be utilized in pitch tracking 
algorithms by introducing a postprocessing 
technique in which the decision of choosing a 
pitch period for a frame of data is delayed until 
several more frames have been evaluated. 

The postprocessing technique utilizing 
dynamic programming requires that a set of 
candidate pitch periods be provided for each frame 
of data along with a measure of the goodness of 
each candidate [1] . For example, the lags of the 
normalized correlation function peaks can be used 
as the pitch candidates, and the magnitude of the 
corresponding peaks can be used as the goodness of 
the candidate. Dynamic programming is utilized to 
construct a series of candidate pitch tracks from, 
frame to frame with a cumulative penalty assigned 


to each track. A smooth pitch contour is obtained 
by choosing the track with the minimum penalty. A 
voicing decision for each frame is made by 
comparing the goodness values associated with the 
smooth contour with the reference templates shown 
in Figure 1. A scanning error is obtained for 
each template by calculating the squared error 
between the template and the goodness values of 
the optimum pitch track. The voiced/ unvoiced 
'decision is made by comparing the scanning errors 
against fixed thresholds [1] . 

Three postprocessing techniques: dynamic 

programming, nonlinear anoothing [2] and median 
smoothing are appended to the Gold Rabiner[3], 
cepstral [4] , and the correlation pitch tracking 
algorithms. A comparative evaluation of these 
postprocessing techniques is performed over a data 
base of 58 male and female speakers. Objective 
test measures were used to compare the pitch 
contours from the postprocessing techniques with a 
hand edited 'reference' pitch contour. The 
objective measures used are shown to be highly 
correlated with subjective listening tests 
conducted over the same data base. 

EXPERIMENT 

To evaluate the performance of the 
postprocessing techniques, data were collected 
frcm 58 speakers, 32 males and 26 females ranging 
in age frcm 6 to 87 years. The subjects were 
prompted with one of 11 phrases. 

A '’reference'' pitch contour was generated for 
each of the 58 tokens of this test data set by 
first extracting a pitch track for each token by 
using the cepstral pitch tracking algorithm; then 
the original waveform, a synthesized waveform and 
the pitch contour were displayed on a graphics 
terminal. By visually comparing the waveforms and 
listening to the original and synthesized speech, 
a decision was made interactively for the pitch 
period in each 10 millisecond frame of speech. 

Subjective listening tests were conducted 
over the test data set by 15 listeners. The 
following five pitch contours were generated for 
each phrase of the data set: 

1. "Reference" pitch contour (hand edited 

starting with cepstral pitch track) . 

2. Cepstral pitch track. 

3. Gold Rabiner pitch track. 

4. Correlation pitch track (basic correlation 
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pre-processing with dynamic programming 
postprocessing) . 

5. Edited correlation (obtained from correlation 
pitch track with hand editing to remove 
major pitch and voicing errors) . 

The subjective tests consisted of a series of A/B 
comparisons in which the listener showed a 
preference for token A, B, or neither. The tokens 
were synthesized speech generated by a 16 pole LPC 
model with a 10 millisecond frame period and pitch 
contours A or B used for the excitation. The two 
pitch contours for each comparison were obtained 
by choosing two contours at a time from the above 
five choices for each phrase. 


Since objective testing is much easier than 
subjective testing, objective distortion measures 
were also used to evaluate the above pitch 
contours and the results were correlated with the 
results of the subjective listening tests over the 
same test set. The assertion is that if there is 
a high correlation between the objective and 
subjective results over the same, test set, then 
the objective distortion measures can be used with 
sane degree of confidence in further testing of 
similar distortions over the same test set. The 
objective measures were weighted distortion errors 
obtained relative to the "reference" pitch 
contour . The weighted distortion error, E C(£) was 
obtained for each contour, c, and phrase, p, by 
summing for each frame in phrase p the following 
errors which occurred when compared with the 
"reference" contour: 


i = E j /E max ( | (Fj-FRj) /FR, | 2 ) FR./500 ) 
So iced /CJnvo iced error : 


PPE 
Voi< 

V0VE e = EVE (FR./500) 
VUVE T = E /E™~71.+fR./500) 


Unvoice/Voiced errAr : 
UWE e = Ej/E^ (F./500) 

UWE =E./E (l.+F ,/500) 

I 1 max r 


where PPE . is the pitch period error, VUVE I is the 
voiced-unvoiced error in the interior of a 
reference voiced segment, VUVE e is the 
voiced-unvoiced error at the ends of a reference 
voiced segment, UWEj- is the unvoiced-voiced error 
in the interior of a test voiced segment and UWE e 
is the unvoiced-voiced error at the ends of the 
test voiced segment, E. is the EMS energy in the 
i > th frame, Ejp ax is the maximum RMS energy in the 
phrase, F. is the pitch frequency in the i'th 
frame for the test contour, is the reference 
pitch frequency in the i'th frame, and 500 Hz is 
the maximum pitch frequency considered. 


Because the subjective and objective test 
results could not be compared directly, functions 
of the test results were used for purposes of 
evaluation. Two such functions were chosen for 
the subjective tests and also two functions were 
chosen for the objective tests as given belcw.* 

First function. 


For this first case, the function of the 
objective distortion error is given by the 
following quantities which express the preference 
of one pitch tracker over another: 


0 1 (l) = l (E - E > 

j=l 2,3 1,3 

. 58 

O (2) = l (E - E > 

j=l 3,3 1,3 

1 58 

0 X (3) = l (E - E > 

i=l 4,3 1,3 


58 


0 1( 4) = l (E 3, j " E 2, j ) 


j=l 

58 


0 1(5) = l (E 4,j - 


j=l 


58 


O 1 ^) “I < e 4 i - e 3 

j=l 4,3 3,3 


where the E Cf j are the above mentioned objective 
distortion 'errors of the c'th pitch contour 
relative bo the reference contour for the j'th 
phrase. Here the c index corresponds to the 

following pitch trackers: 

c = 1 - correlation pitch track 

c = 2 - Gold-Rabiner 

c = 3 - cepstral 

c = 4 - edited correlation. 

Therefore 0!(1) would be the preference of the 
correlation pitch track relative to the 
Gold-Rabiner pitch track averaged over all 58 
phrases. 

Similarly the subjective function, 
S 1 (i) ,i=l,6 is the corresponding preference shown 
by the listeners in the subjective listening test. 
That is, S 1 (1) is the total number of times (over 

all the phrases and all the listeners) the 

correlation pitch contour was preferred over the 
Gold-Rabiner contour minus the number of times the 
Gold-Rabiner contour was preferred ever the 
correlation contour. 

Second function. 

The second function of the objective 
distortion errors to be considered is given by the 
following expression: 

2 58 

O (i) = l E ; i=l,2..4 

j=l 1 ' 3 

where E ± ^ is again the objective distortion error 
of the' i'th pitch contour relative to the 
"reference" contour for the j'th phrase. The 
corresponding function of the subjective test 
results is obtained by first calculating the total 
number of times a pitch contour is preferred by 
each listener. The subjective function is then 
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given by: 


V R - 


where y R is the mean of the listeners preference 
for the "reference" contour and Vi is the mean of 
the listeners preference for the i'th contour. 

The correlation coefficients for the two 
functions are given by: 


(o 3 (i) - o j ) (s 3 (i) - s ) 


‘ M . . -thr M . nl 

l (o 3 (i) - o 3 ) 2 l (S 3 (i) - S 3 ) 2 

-i=l J Li=l 


RESULTS 

To establish the methods of evaluation, the 
results of the subjective listening test and their 
correlation with the objective measures are 
presented. Then the results of testing the 
various postprocessing techniques are given along 
with a discussion of these results. 

A total of 15 listeners completed the 
subjective listening tests. The five contours 
shown above were compared on the test data set. 
The results of this test are given in Figures 2 
and 3. Figure 2 shows the results of the first 
function above showing the preference of one pitch 
tracker over another having been averaged over all 
58 phrases and the 15 listeners. Similarly, 
Figure 3 shows the results of applying the second 
function to the subjective test results, where the 
mean was obtained from each listener's preference 
for the particular pitch contour over all 58 
phrases. 

The result of comparing the last four 
contours above against the "reference" contour 
over the test data set is given using objective 
measures. The results of using the first function 
above are given in Figure 4 and the results for 
the second function are given in Figure 5. 

Comparing the subjective listening test 
results with the objective test results for the 
first function gives a correlation coefficient 
p^O.99. 

Similarly the results for the second 
functions of the objective and subjective test 
results gives the correlation coefficient p 9 =1.0. 

It can be seen that the correlations are high 
for both the functions. This is partly due to 
smoothing of the data because of averaging, but it 
is reasonable to assume that other pitch contours 
generated for this same data set would have 
similar strong correlations. Therefore the 
evaluations of the postprocessing techniques were 
performed with the objective testing methods. 


The results of objective evaluation of the 
postprocessing techniques as implemented on the 
basic pitch tracking algorithms are given in 
figures 6 and 7. 

CONCLUSIONS 

It has been shown that significant 
improvement in the performance of three basic 
pitch tracking algorithms can be accomplished by 
using a dynamic programming postprocessing 
technique and that sane improvement is obtained by 
using nonlinear smoothing and median smoothing 
postprocessing techniques. 
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Figure 1: Reference Voicing Patterns 
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Preference of contour i over contour j 
where : 

1 correlation 

2 - - Gold Rabiner 

3 cepstral 

4 edited correlation 

Figure 2: Subjective test results using 
function S 1 . 
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Figure 5: Evaluation results for 

function 0 2 on objective test. 
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Objective preference of contour i over contour j where: 

1 — correlation with dynamic programming 

2 -- correlation with nonlinear smoothing 

3 — correlation with 3-pt median smoothing 

4 — correlation without postprocessing 

5 — Gold Rabiner with dynamic programming 

6 -- Gold Rabiner with nonlinear smoothing 

7 — Gold Rabiner with 3 pt median smoothing 

8 — Gold Rabiner without postprocessing 

9 — cepstral with dynamic programming 

10 — cepstral with heuristics 

11 — cepstral with nonlinear smoothing 

12 — cepstral with 3 pt median smoothing 

13 -- cepstral without postprocessing 


Figure 6: Evaluation of postprocessing techniques 
with function 0 1 on weighted objective 
errors. > 
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Figure 7: Evaluation of postprocessing techniques with 
weighted objective measures. 
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